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Abstract 

The minimal representation tt of the indefinite orthogonal group 
0(m + 1, 2) is realized on the Hilbert space of square integrable func- 
tions on R m with respect to the measure | a: | — 1 rfa: i • • • dx m . This article 
gives an explicit integral formula for the holomorphic extension of n 
to a holomorphic semigroup of 0(m + 3, C) by means of the Bessel 
function. Taking its 'boundary value', we also find the integral kernel 
of the 'inversion operator' corresponding to the inversion element on 
the Minkowski space l" 1,1 . 
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1 Introduction 

1.1 Semigroup generated by a differential operator D 

Consider the differential operator 

m i m r>2 

j=l j=l 3 

on M m . A distinguishing feature here is that D has the following properties 
(see Remark 3.4.4): 

1) D extends to a self-adjoint operator on L 2 (R m , g). 

2) D has only discrete spectra {-(j + ^i) : j = 0, 1, ■ ■ ■} in L 2 (M. m , g). 
Therefore, one can define a continuous operator 

OO 

e tD = y t D k 

m— 1 r> j. 

for Re t > with the operator norm e 2~ n satisfying the composition 
law 

e tiD Q e t 2 D = g (ti+t 2 )D_ 

Thus, e* D (Ret > 0) forms a holomorphic one-parameter semigroup. Be- 
sides, the operator e tD is self-adjoint if t is real, and is unitary if t is purely 
imaginary. 
We ask: 

Question. Find an explicit formula of e tD . 
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In this context, our main results are stated as follows: 

Theorem A (see Theorem 5.1.1). The holomorphic semigroup e tD (Ret > 
0) is given by 

(e tD u)(x)= ( K+{x,x';t)u(x')p^ for u £ L 2 (R m ,p-), 
Jk™ \ x I \ x \ 

where the integral kernel K + (x,x';t) is defined by 

K + {x, x'; t) : = Im-s r ) / . 

vrVsinh" 1 " 1 ! sinh| J 

Here, we set I u {z) := (|) u I u {z) (I v is the I -Bessel function (see (8. 5. 2) ) 
and 

ip(x,x') := 2y / 2(\x\\x'\ + (x,x'}) = 4|ar|5|x'|5 cos -, 

where 6 = 6(x,x') is the Euclidean angle between x and x' in R m . 
Particularly important is the special value at t = ir\f^l. We set 
K + (x,x') := limK + (x,x';7rv /r T + e) 

ej.0 

m — 1 . m — 3 

.i m-i Jm=3{ip{x,x)) 



' — 1 7T 2 
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I r-m— 1 m- 

V— 1 7T 2 

Corollary B (see Theorem 6.1.1 and Corollary 6.2.1). The unitary 
operator e*^^ on L 2 (R m , ^j) is (/iwen 6t/ i/ie Hankel-type transform: 



X 



T:L 2 (R m ,pr)^L 2 (R m ,p-), u» f K + (x,x')u( 
\ x \ \ x \ Jm. m 

This transform has the following properties: 

(Inversion formula) T _1 = (— l) m+1 T. 

(Plancherel formula) \\Tu\\ L 2mm dx\ = \\u\\ L2 ( Km dx\. 

\ ' l x l ' \ x \ 

Let us explain the backgrounds and motivation of our question from 
three different viewpoints: 

(1) Hermite semigroup and its variants (see Subsection 1.2). 

(2) sfe-triple of differential operators on R m (see Subsection 1.3). 

(3) Minimal representation of the reductive group 0(m + 1, 2) (see Sub- 
section 1.4). 
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1.2 Comparison with the Hermite operator D 

Let us compare our operator D on L 2 (M. m , with the well-known operator 
D on L 2 (R m , dx) defined by 

V:=\(A-\x\ 2 ). (1.2.1) 

We call this operator the Hermite operator following the terminology of 
R. Howe and E.-C. Tan [17]. Analogously to D, the Hermite operator © 
satisfies the following properties: 

1) T> extends to a self-adjoint operator on L 2 (R m , dx). 

2) D has only discrete spectra + § ) : j = 0, 1, • • •} in L 2 (R m , dx). 
We recall from [16, §5.3 and §6] that D gives rise to a holomorphic 

semigroup e* 15 (Ret > 0) (Hermite semigroup). Then the following results 
may be regarded as a prototype of Theorem A and Corollary B. 

Fact C (see [16, §5] [31, §4.1]). The holomorphic semigroup e 1 ^ (Ret > 
0) is given by 

(e tv u)(x)=[ X(x,x';t)u(x')dx', 
where % is the Mehler kernel defined by 

Here, we set 



In light of the limit formula: 

lim %(x, x'; + e) 



-l(x,x') 



elO " ' (27T^/^T)T 



the special value of the operator e tr> at t = -K\[^\ reduces to the (ordinary) 
Fourier transform: 

Fact D. The unitary operator e^v^ 15 n L 2 (IR m ,da;) is nothing other than 
the Fourier transform 1: 

(37)(z) = 1 [ e-^>*y(x')dx'. 

(27TV-1) 2 JM. m 

We shall see in Section 6 a group theoretic interpretation of the fact that 
T is unitary and T 4 = id as well as the fact that $ is unitary and 9~ 4 = id. 
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1.3 The action of SL(2,Ryx 0(m) 

The self-adjoint operator D denned by (1.1.1) arises in the context of the 
s[2-triple of differential operators on R m as follows. We define 

m q r—j 

h = 2 Vij- + m- 1, e = 2v /z T|x|, f = i— | X |A. (1.3.1) 

These operators h, e and / are skew self-adjoint operators on L 2 (R m ,^), 
and satisfy the s[2-relation: 

[h,e]=2e, [h,f] = -2f, [ej] = h. 

The operator D has the following expression 

D = ^=(-e + f), (1.3.2) 

which means that y/—lD corresponds to a generator of so(2) in sl(2,R). 
The s^-module C^°(R m \ {0}) exponentiates to a unitary representation of 
SX(2,R) on L 2 (R m , j§j) (see Subsection 2.3 and Lemma 3.4.1). 

On the other hand, there is a natural unitary representation of the or- 
thogonal group 0(m) on the same space L 2 (R m ,|^), and the actions of 
SX(2,R) and 0(m) mutually commute. Then we have the following dis- 
crete and multiplicity-free decomposition into irreducible representations of 
SL(2,R) x 0{m) (see [22, Theorem A]): 

oo 

1 1 3=0 

Here, W (R m ) denotes the space of harmonic polynomials on R m of degree j, 
and 7]-^ i ( 2,R ) stands for the irreducible unitary lowest weight representation 
of SL(2, R) with minimal K-type C b for b G N+ = {1, 2, • • • }. It is the limit 
of discrete series if b = 1, and holomorphic discrete series if b > 2. 

In contrast, the Hermite operator D (see (1.2.1)) arises from the following 
sl2-triple: 

^=X>4 + ?. *=-^V. /'-^A. (1-3.3) 

3=1 J 

where the Hermite operator D is given by 

V = ^=(-e> + f>). (1.3.4) 
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This s^-triple also gives rise to the commutative actions of the double cov- 
ering group SL(2,IR)~of SL(2,R) and 0(m) on L 2 (R m ), whose irreducible 
decomposition amounts to (see [17, Chapter III, Theorem 2.4.4]) 

oo 

L 2 (R m ,dx)~ ^vf^M^M" 1 ). 

3=0 

Here, 7r ^ L( - 2 ' R ^ stands for the irreducible unitary lowest weight representation 
of 5L(2,Mj'with minimal K-type C b for b £ ±N+ = {±,1, §,•••}. It is 
the Weil representation if b = \, and is obtained by the representation of 
5L(2,M) if b G N+. 

1.4 Minimal representation as hidden symmetry 

The representation of SL(2,R) x O(m) on L 2 (R m , jfj) in Subsection 1.3 ex- 
tends to the irreducible unitary representation ir + of the double covering 
group G := SOo(m + 1,2)" of the indefinite orthogonal group (see Subsec- 
tions 2.3 and 3.1). If m is odd, this representation is well-defined also as a 
representation of SOo(m + 1,2). 

Similarly, the representation of SL(2,IR)~x 0(m) on L 2 (R m ,dx) extends 
to the unitary representation w of the metaplectic group G' = Sp(m,Ry. 

These groups G and G 1 may be interpreted as hidden symmetry of 
SL(2,Ryx 0(m). Conversely, the group SL(2,M)~x 0(m) forms a 'dual 
pair' in each of the groups G and G' . 

The unitary representations 7r+ and w are typical examples of 'mini- 
mal representations' of reductive Lie groups in the sense that the Gelfand- 
Kirillov dimension attains its minimum among infinite dimensional unitary 
representations or in the sense that its annihilator is the Joseph ideal in the 
enveloping algebra. 

The unitary representation tt + may be interpreted as the mass-zero spin- 
zero wave equation, or as the bound states of the Hydrogen atom (in m 
space dimensions), while the representation w is sometimes referred to as 
the oscillator representation or as the (Segal-Shale-)Weil representation. 

We shall review the L 2 -realization of the minimal representation ir + of 
SOo(m + 1, 2JJ that is, the analog of the Schrodinger model on L 2 (R m , ^j) 
in Subsection 3.1. See also [8, 16] for a nice introduction to the original 
Schrodinger model of the Weil representation of Sp(m,Rjon L 2 (IR m ). 

To be more precise, we take 

-(Si)- /-(!!). *=^=G- O 
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to be a basis of s[(2,M) and define injective Lie algebra homomorphisms 

4> : «[(2,R) -► ao(m+ 1,2), 
99 : «[(2,R) ->sp(m,M) 

(see Subsection 3.3) such that the differential operators (1.3.1) and (1.3.3) 
are obtained via <f> and <p, respectively, that is, 

dir+((j>{X)) = X, dvj{<p{X)) = X' 

holds for X = e,f,h. Next we set 

Then eV-i^-<t>(z) [ s fa e ce nter of the maximal compact subgroup of G for 
m > 1, while e ^~-~t Rl P( z ) [ s that of G' (we use the same notations (f> and 92 for 
their complex linear extensions). 

In this context, we shall see in Lemma 3.4.3 and Remark 3.4.5 that the 
differential operators D and D are given by 

D = dTi + (<P(z)), D = dzu(ip(z)). (1.4.1) 

Thanks to these formulas, Theorem A and Corollary B are also useful in 
the analysis on minimal representations of SOo(m + 1, 2)~as well as Sp(m, 
in the following contexts: 

1) The Gelfand Gindikin program — Theorem A. 

The Gelfand-Gindikin program asks for extending a given unitary rep- 
resentation of a real semisimple Lie group G to a holomorphic object of 
some complex submanifold in its complexification G?c- Stanton and 01- 
shanskh [29, 27] independently gave a general framework of the Gelfand- 
Gindikin program for holomorphic discrete series. Their abstract results are 
enriched, for example for G' = Sp(m, M.f, by the explicit formula of the Her- 
mite semigroup e* 15 = w(e t(p ^) for the Weil representation w on L 2 (M. m ) by 
Howe [16]. Likewise, Theorem A gives an explicit formula of the semigroup 
e tD = 7r+ (e t<?!> ( z ) ) for the minimal representation of G = SOo(m + l, 2)T Since 
e t4>(z) g \ c for Re t > 0, Theorem A can be interpreted as a descendent 
of the Gelfand-Gindikin program. 

2) The unitary inversion operator — Corollary B. 

In the Schrodinger model of the minimal representation, G acts only on 
the function space L 2 (R m , but does not act on the underlying geometry 
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M m itself. One may observe this fact by the aforementioned formula / = 
dir + ((/)(/)), which does not act on functions on M m as a vector field but acts 
as a differential operator of second order on R m (see (1.3.1)). To see how G 
acts on L 2 (IR m , we use the facts that 



1) G is generated by P max and wq. 

2) The P max action on L 2 



171 , j^) is easily described (see Subsection 



2.2). 

Here, _P max is a maximal parabolic subgroup of G (see Subsection 2.1) 
and u>o := e^v^z ^ q sen( \ s pmax ^ Q ^ s opposite parabolic subgroup _p max . 
Geometrically, P max is essentially the conformal affine transformation group 
on the flat standard Lorentz manifold W 11 ' 1 (the Minkowski space), and 

Wo .— „TT\/^1Z r- r< ™ TDim,l 

6.1). 



1Z £ G acts on 



as the 'inversion' element (see Subsection 



Thus the representation ir + of G on L 2 (R m , ^) would be understood if 
we find an explicit formula for tt + (wo). But since the formula wq = e 77 ^^^ 



implies tt + (wq) = e" 



-ID 



, Corollary B answers this question. This parallels 



the fact that the Weil representation is generated by the (natural) action of 
the Siegel parabolic subgroup -Psiegei and the Fourier transform 3~ = e 7T ^~^' I> 
(see Fact D). 

Briefly, we pin down the analogy in the table below. Howe [16] estab- 
lished the left-hand side of the table for the oscillator representation w of 
Sp(m, RJ^ while Theorem A and Corollary B supply the right-hand side of 
the table for the minimal representation ir + of SOo(m + 1, 2JT 



5p(m, 



so{m + 1,2) 



minimal representation 

e 

/ 
h 



(dw, I? 



\x\ 



-l 



(dir + ,L 2 { 

x\A 



dx\\ 
' \x\» 



Z 



-e+f 



tz 



2V-1 

holomorphic semigroup e 



inversion e 
maximal parabolic subgroup 



D 



E x + y 

4( A -N 2 ) 

X(x,x';t) 
Fourier transform 

^Siegel 



2 Err. 



1 



D 



, x +m- 

= iM A 

K(x,x';t) 
Hankel transform 



Analogous results to Corollary B were previously known for some singu- 
lar unitary highest weight representations. For example, see a paper [4] by 
Ding, Gross, Kunze and Richards for those of U(n,n). Since SU(2, 2) is a 
double covering group of S*Oo(4, 2), Corollary B in the case m = 3 essentially 



9 



corresponds to [4, Corollary 7.5] in the case (n, k) = (2, 1) in their notation. 
However, our proof based on an analytic continuation (see Theorem A) is 
different from theirs. Also in [20], we shall find the inversion operator tt(wo) 
for the minimal representation of 0(p,q) for p + q even, and in particular 
give yet another proof of Corollary B for odd m. 

We also present explicit integral formulas of Tr(e tz ) and 7t(wo) when 
restricted to radial functions and alike (see Theorem 4.1.1). This yields a 
group theoretic interpretation of some classic formulas of special functions 
of one variable including Weber's second exponential integral formula on 
Bessel function and the reciprocal and the Parseval-Plancherel formula for 
the Hankel transform. 

This article is organized as follows. After summarizing the preliminary 
results on the L 2 -model of the minimal representation tt, we find explicitly 
which function arises for describing K- types in L 2 (M. m , f^), and define a 

\x\ 

holomorphic extension ir+(e tz ) in Section 3. The integral formula of the 
'radial' part of TT + (e tz ) is given in Theorem 4.1.1. Theorem A is proved 
in Section 5 by using the result of Section 4. Taking the special value at 
t = tt\/—1, we obtain the integral formula of ir(wo) corresponding to the 
inversion element u>o. This corresponds to Corollary B, and is proved in 
Section 6. Our integral formula for tt(wo) enables us to write explicitly the 
action of the whole group G = SOo(m + 1, 2)~on L 2 (R m , ^). This is given 
in Section 7. For the convenience of the reader, we collect basic formulas of 
special functions in a way that we use in this article. 

The main results of the paper were announced in [19] with a sketch of 
the proof. 

Notation: N = {0, 1, 2, . . . }, N+ = {1, 2, 3, . . .}, M< = {x e R : x < 0}, 
R + = {x e M : x > 0}. 

2 Preliminary results on the minimal representa- 
tion of 0(m + 1,2) 

This section gives a brief review on the known results of the L 2 -model of the 
minimal representation of 0(m + 1,2) in a way that we shall use later. We 
shall give an explicit action of the maximal parabolic subgroup P max and 
the Lie algebra g. Furthermore, we state an explicit if- type decomposition 
of -L 2 (C+) even though the action of K itself is not given explicitly here (see 
Section 7 for this). 
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2.1 Maximal parabolic subgroup of the conformal group 

Let 0(m + 1,2) be the indefinite orthogonal group which preserves the 
quadratic form + - ■ ■+Xm~ x m+i~ x m+2 of signature (m+1, 2). We denote 
by eo, ■ ■ ■ , e m+ 2 the standard basis of R m+3 , and by Eij (0 < i, j < m + 2) 
the matrix unit. We set 



Ej : = 



1 (l<i<m), 
— 1 [j = m + 1). 



We take the following elements of the Lie algebra o(m + 1, 2): 

N j := E j,o + E j,m+2 - £jEo,j + £jE m+2 ,j (1 < j < m + 1), 

:= Ejfi - E j>m+2 - EjEoj - SjE m + 2 j (1 < j < m + 1), (2.1.1) 
:= -Eb,m+2 + E m+2 fi, 



E 



and define subalgebras of o(m + 1, 2) by 

ra+l m+1 

n 55 ^ := RNj, n max := ^ 

j=l 3=1 



j, a := 



Then we define the following subgroups of 0(m + 1, 2): 

M max . = | 5 G + i 5 2 ) : 5 • e = e , g- e m+2 = e m+2 } 
~ 0(m, 1), 

M max . = M max J {_/ m+3 } . M™* 

~ 0(m,l) x Z 2 , 



max 



TV 

jymax 



max \ 



= exp(n 
= exp(n max ), 
= exp(a). 



For b = (6i, . . . , 6 m+ i) G R m+1 , we set 

m+1 



n 6 := exp(J^ 6,-iVj) (2.1.2) 

3=1 

= Im+3 + ^2 bjNj + ^ - (—^0,0 _ -E'o.m+l + ^m+1,0 + -E'm+l.m+l), 
3=1 
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where Q(b) is the quadratic form of signature (m, 1) given by 

Q{b) :=bl + --- + b m -b m+1 . 
The Lie group iV max is abelian, and we have an isomorphism of Lie groups: 

r^+i-^ b^n b . 
It is readily seen from (2.1.2) that 

nbieo - e m+2 ) = e - e m+2 , (2.1.3) 
n fe (e + e m+2 ) = *(1 - Q(6), 2&i, . . . ,26 m+1 , 1 + Q(&)). (2.1.4) 

We also note 

e tE {e + e m+2 ) = e*(e + e m+2 ). (2.1.5) 

The subgroup M™ ax iV max is isomorphic to the semidirect product group 
0(m, 1) x M m+1 via the bijection W rn+1 ^ A^ max , b n 6 . In this context, 
^maxjymax j s regarded as the group of isometries of the Minkowski space 
M" 1 ' 1 , while 0(m + 1,2) is the group of Mbbius transformations on W n ' 1 
preserving its conformal structure. 

Next, we define a maximal parabolic subgroup 

pmax ._ ^max^jymax 

In our analysis of the minimal representation of 0(m+ 1, 2), P max plays 
an analogous role to the Siegel parabolic subgroup of the metaplectic group 
Sp(m, ]R)~ for the Weil representation. 

2.2 L 2 -model of the minimal representation 

We shall briefly review the L 2 -model of the minimal representation of 0(m+ 
1,2). Let C± be the forward and the backward light cone respectively: 

C± := {(Ci, • • • , Cm+i) G M m+1 : ±Cm+l > 0, Ci + ■ " " + Cm = C+l}, 

and C be its disjoint union C+ U C+, that is, C is the conical subvariety 
with respect to the quadratic form of signature (m, 1): 

C = {CGM m+1 \{0}:Q(C) = 0}. (2.2.1) 

Note that M™ ax acts on C transitively. 

The measure d[i on C is naturally defined to be S(Q), the generalized 
function associated to the quadratic form Q (see [11, Chapter III, §2]). 
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Then we form a unitary representation tt of P" 
L 2 (C,dfi) = L 2 {C) as follows: for i/> G L 2 (C), 



(7r(m)^)(C) 

(7T(-/ m+3 )V)(C) 

(vr(n b )V)(C) 



e-— V(e-*C) 

(-1)^^(0, 

e 2 v AZ T(6iCi+---+WiCm+i)^,^^ 



on the Hilbert space 

(t G M), (2.2.2) 
(mGM™ ax ), (2.2.3) 

(2.2.4) 

(b G R™+i). (2.2.5) 



Then 7r is irreducible and unitary as a P max -module, and it is proved in [23, 
Theorem 4.9] that the P max -module (tt, L 2 (C)) extends to an irreducible 
unitary representation of 0(ra + 1,2) if m is odd. We shall denote this 
representation of 0(m + 1, 2) by the same letter tt. The direct sum decom- 
position 

L\C) = L 2 {C + ) © L 2 (C_) (2.2.6) 

yields a branching law tt = ir + © 7r_ with respect to the restriction 0(m + 
1,2) J, SOo(m + 1,2), where SOo{m + 1,2) is the identity component of 
0(m + 1,2). The irreducible representations 7r + and 7r_ of SOo(m + 1,2) 
are contragredient to each other, one is a highest weight module, and the 
other is a lowest weight module. 



2.3 K-type decomposition 

Let SO{2j be the double covering of 50(2). We write r\ for the unique 
element of SO (2)~of order two. Then, we have an exact sequence: 

1 -► {l,r?} -» 50(2J^ 50(2) 1. 

Let 

G = 5O (m + l,2j' (2.3.1) 

be the double covering group of SOo(m + 1,2) characterized as follows: a 
maximal compact subgroup K is of the form K\ x K-i ~ 50 (m + 1) x 
50(2)"and the kernel of the covering map G — > SOo(m + 1,2) is given by 
{(1, 1), (1, 77)}. Likewise, the double covering group 0(m+l, 2j"of 0(m+l, 2) 
is defined. 

If m is odd, the irreducible representation (ir±, L 2 (C±)) defined in Sub- 
section 2.2 extends to that of SOo(m + 1,2), and therefore, also that of 
G = 50o(m + 1,2)" as we proved it more generally for 0(p,q) (p + q : 
even) in [23]. We shall use the same letter ir+ to denote the extension to 
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SOo(m + 1, 2) or G. If m is even, by [28], the irreducible unitary represen- 
tation (ir±, L 2 (C±)) is still well-defined as a representation of G, whose Lie 
algebra = so (to + 1, 2) of G acts in the same manner as in the case of odd 
to (see Subsection 2.4). 

The K-type formula of (tt±, L 2 {C±)) is given as follows: 

oo 

L 2 (C±) K ~ !K a (R m+1 ) m Ce ±(a+2 ^ i)v ^ Te . (2.3.2) 

a=0 

(For example, this formula can be read from [28, §1.3] by substituting d = 
m — l,p = 1 and q = 0.) Here, ;H a (IR m+1 ) stands for the representation of 
SO(m + 1) on the space of the spherical harmonics which is irreducible if 
to > 1 (see Subsection 8.4). 

Likewise, the representation (tt, L 2 (C)) of 0(to + 1, 2)~decomposes when 
restricted to its maximal compact subgroup as follows (see [21, Theorem 
3.6.1]): 

oo 

L 2 (C) K ~0M fl (i m+1 )M{ a+5 r(l 2 ). (2.3.3) 

a=0 

^^(M 2 ) decomposes into Ce^^^ 8 Ce-^^^ 8 as SO(2)- 
modules (see Subsection 8.4). This corresponds to the decomposition 

L 2 (C) = L 2 (C + )eL 2 (C_), 

for which the K-type formula is given by (2.3.2). 



2.4 Infinitesimal action of the minimal representation 

For Nj, Nj(l < j < m + 1) and E, we define linear transformations on the 
space S'(lR m+1 ) of tempered distributions by 

dw(Nj) := 2^/^^( j , (2-4.1) 
<IMN,) :- V^l (—e^ - E ( e,± + *Ca) ■ <*•«) 
dw(E) := - E ( , (2.43) 



where we set 



k : <Ki • 0g <K 2 , i>C . , • ^ : -^ C ^C/ 
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Then, we recall from [23] that this generates the infinitesimal action 
d-ir of the Lie algebra so (to + 1,2), and we have the following commutative 
diagram for any X G So(m + 1, 2): 



K 



dir(X) 
L 2 (C)k 



S'(M m+1 ) 

dw{X) 
§'(l m+1 ). 



(2.4.4) 



Here, i : L 2 {C) -► S'(M m+1 ) is given by u{Q 
defined and injective if to > 1 (see [23, §3.4]). 



u(()5(Q). This is well- 



3 Branching law of tt + 

The main goal of this section is Proposition 3.2.1, which explicitly de- 
scribes special functions that arise as -KT-types in the 'Schrodinger model' 
on L 2 (IR m , [xj^ 1 ^) of the minimal representation of the double covering 
group G of SO (m+ 1,2). 



3.1 Schrodinger model of the minimal representation 

We have used the variables ( = (£i, • • • , Cm+i) for the positive cone C + C 
jjm+i j n Section 2, and will use the letter x = (x\, ■ ■ ■ , x m ) for the coordinate 
of R m . The projection 

p:R m+1 ^R m , (Cl,-" ,Cm,Cm+l)^(Cl,--- ,Cm)- (3.1.1) 

induces a diffeomorphism from (7+ onto M m \{0}, and the measure d\x on C+ 
is given by S(Q), and therefore is pushed forward to ^^dx = 2\£\dx\ ■ ■ ■ dx m . 
Thus, we have a unitary isomorphism: 

vV : L 2 (R m , 0) ^ L 2 (C+). (3.1.2) 

Through this isomorphism, we can realize the minimal representation of 
G on L 2 (]R m , r§) as well. Named after the Schrodinger model of the Weil 
representation, we say this model is the Schrodinger model of the minimal 
representation of G. We shall work with this model from now on. 
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3.2 X-finite functions on the forward light cone C + 

This section refines the K-type decomposition (2.3.2) by providing an ex- 
plicit irreducible decomposition: 

, oo oo a 

L\M m , ^k = 0^ = 0© W a>l (3.2.1) 

I I a=0 a=0 Z=0 

according to the following chain of subgroups: 

G D K D R := K n (M| nax ) 

ii ii n 

SOo(m + 1, 2j~ D SO(m + 1) x SO{2j D SO{m). 

Here, the K-irreducible subspace W a of L 2 (M m , ^) and the i?- irreducible 
supspace W a j of is characterized by 

W a ~ Jf a (M m+1 ) El Ce^^ 9 (see (2.3.2)), (3.2.2) 
W a ^K l (R m ), (3.2.3) 

as .fT-modules and as i?-modules, respectively. Here, we note that the 
50(m)-module < K l (M m ) occurs exactly once in the 0(m+l)-module "K a {W" l+1 ) 
if < / < a (see Subsection 8.4 (4)). 

Proposition 3.2.1 will describe the subspace W a j of L 2 (R m , 0) by means 
of Laguerre polynomials Lf t (x) (see (8.1.1) for the definition). For this, we 
set 

fa,l(r) ■■= L™- 2+2l (4r)r l e- 2r (0 < I < a), (3.2.4) 
and define injective linear maps by 

j atl : tf(R m ) - C°°(]R m ), <f>(co) » {j a ,i4>){ru) := f a ,i(r)<f>(u). 

Here, we have identified W 11 with E + x S™ 1 ^ 1 by the polar coordinate 

RxS™- 1 ^!™, {r,uj)^ruj. (3.2.5) 

Then, we have: 
Proposition 3.2.1. 1) 

J.i^D) C L\R m , 0) n L 2 (M m , 0). (3.2.6) 

2) Furthermore, the image of j a j coincides with the R-type W a ,z ; 

j atl (H l (R m )) =W a ,i. 
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Remark 3.2.2. Proposition 3.2.1 (2) asserts in particular that j a ,i{^C l (R m )) 
and j a 'j{'K l (W n )) are orthogonal to each other if a ^ a! (a, a' > I). More 
than this, it gives a representation theoretic proof of the fact that {f a ,i(r) : 
a = I, I + 1, • • •} forms a complete orthogonal basis of L 2 (K + ,r m ~ 2 dr) (see 
Lemma 4-3.1 for the normalization). 

Remark 3.2.3. The indefinite orthogonal group 0(p,q) (p + q : even, p,q> 
2, and (p,q) / (2,2)) has a minimal representation tt whose minimal K- 
type is of the form J{ U (IR P ) <g) "K~ (W) if p > q. In the L 1 -model of tt, we 
have proved that any M max -fixed vector in !H (IR P ) (g> "K 2 ^ (M. q ) is a scalar 
multiple of the function r"^ K q -z (2r) (see [23, Theorem 5.5] for a precise 

2 

statement), where K v (z) denotes the K-Bessel function. Since K_i(2r) = 
V^ r -\ e -2r and L a( x ) = l} we have r ^ 1 K 2 - 1 (2r) = ^fe~ 2r = ^f , {r) if 
q = 2. This vector is a generator of the one dimensional vector space Wq$. 

Remark 3.2.4 (Weil representation). Let us compare our representation 
on L 2 (M. m , \x\~ 1 dx) with the (original) Schrodinger model on L 2 (W m ) of the 
Weil representation of G' = Sp(m,~Ry. The counterpart to Proposition 3.2.1 
can be stated as follows: we set for < I < a 

to — 2 i j 2 

f^(r) := V, + We-^, 
and define linear maps by 

Then for any <fi G Ji'(l m ), j'aii'fi) ^ s square integrable on M. m , and its image 
f al CK l (M. m )) is characterized by the following properties: Let (K',R r ) = 
{U{mJ,0{mJ). 

1) j' al (tf(R m )) is isomorphic to 3i l (R m ) as R' -modules, 

2) it is contained in the K' -type isomorphic to S a (C) (8> det4 . 

The remaining part of this section is organized as follows. In Subsection 
3.3, we shall define a central element Z of (the complexification of ) the 
Lie algebra t of K, and compute its differential action dir + (Z) (see Lemma 
3.4.3). By using this explicit form of dir+(Z), we prove Proposition 3.2.1 
in Subsection 3.5. Finally, in Subsection 3.6, by looking at the eigenvalues 
of dir + (Z) (see Lemma 3.5.1), we shall see that {ir + (e tz ) := exp(t<i7r + (Z)) : 
Re t > 0} forms a holomorphic semigroup of contraction operators. 

In Section 5, we shall find an explicit integral kernel of this semigroup 
by using Proposition 3.2.1. 



(3.2.7) 
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3.3 Description of infinitesimal generators of sl(2, R) 
Let 

-(Si). *=M=(i-°x)- 

be the standard basis of s[(2,R). With the notation (2.1.1), we define a Lie 
algebra homomorphism 

0:s[(2,R)->so(m + l,2) (3.3.1) 

by 

0(e) = iV m+1 , <f>(f) = N m+1 , 4>{h) = -2E. (3.3.2) 

In this subsection, we shall explicitly describe dw + ((f>(e)),dTr + ((j)(f)), and 
dir + ((/)(h)) as differential operators on M m . 

Lemma 3.3.1. Lei i£ x = a^'gfr A = Y^j=i Then we have: 

dn+(<j>(h)) =2E X + m- 1, (3.3.3) 
d7r+(0(e)) =2v /z l|x|, (3.3.4) 

dTT+m)) =^\x\A. (3.3.5) 

Remark 3.3.2. Lemma 3.3.1 corresponds to an analogous result for the 
Schrddinger model of the Weil representation (m,L 2 (W m )) of Sp(m,Wy as 
follows: by the matrix realization of the real symplectic Lie algebra sp(m,M) , 
we define a Lie algebra homomorphism (p : sl(2,M) — > sp(m,M) by 




(3.3.6) 



Then, {dm(ip(h)),dm((p(f)),dm(tp(f))} is no other than the ^-triple of 
differential operators {h',e',f'} on M m given in (1.3.3). 

Proof of Lemma 3.3.1. First we compute dir + ((f)(h)) = dir + {—2E). For this, 
we use the formula of dm on R m+1 in Subsection 2.4, and then compute the 
formula of dn + on the positive cone C + (or on the coordinate space M. m ) 
through the embedding i : L 2 (C) -► S'(IR m+1 ), u(() ^ u(()5(Q). Since 
the distribution 8(Q) is homogeneous of degree —2, we note that E^5(Q) = 
-25{Q). Therefore, 

(dir+(-2E)u)S(Q) = - 2dm(E){u5(Q)) by (2.4.4) 

= (2E ( + m + 3){uS{Q)) by (2.4.3) 
= {2E c + m- l)u-5(Q). 
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Now by identifying L 2 (C+) with L 2 (R"\ jfj) by (3.1.1), we obtain (3.3.3). 

The second formula (3.3.4) follows immediately from (2.4.1). 

We shall show the third formula (3.3.5). In light of </>(/) = N m+ \ (see 
(3.3.2)), by (2.4.2), we have 

dMm) = ^ ( ^_A_ + £< _?_ + ^ n< ). (3.3.7) 

In order to compute the action dm(<f>(f)) along the cone C+, we use the 
following coordinate on R m+1 : 

R x R+ x S" 1 - 1 ->■ R m+1 , (Q,r,w) ^ (rw, \/r 2 - Q)- (3-3.8) 

Claim 3.3.3. Wri/i the above coordinate, the differential operator dw((f>(f)) 
on S'(R m+1 ) takes the form: 

/ — - i-^ — tt/ 1 <9 2 m — 1 d Acm-i ^ d 2 i d \ 
*£#(/)) = ^^Q^ + -^-8-r + ^- 2Q W-'d0)- 

Proof of Claim 3.3.3. We start with a new coordinate R m+1 = R m © R by 
R+ x^- 1 xR^R m+1 , (fl,w,C m +i)-»(i2o;,Cm+i)- (3-3.9) 
Then, clearly, 

F -R 9 + t 9 



<9 2 / <9 2 m — Id 1 \ <9 2 

=ARra " ^ = + — m + t^- 1 ) ~ oc^- 

The coordinate (3.3.8) is obtained by the composition of (3.3.9) and 

r = R, Q = Ri-(l +l . 

In light of 

we get 

B <=4r +2Q i' < 3 ' 311 > 
d 2 „ d 2 d 2 , N d m - 1 d A Sm -i 

(3.3.12) 

Now substituting (3.3.10), (3.3.11) and (3.3.12) into (3.3.7), we get the claim. 

□ 
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Given u G L 2 (C+)k, we extend it to a distribution u = u(Q,r,u) G 
S'(R»"+i) n C°°(IR m \ {0}) such that 

uS(Q)=uS(Q). 

We set 

S:=2^^(«|L + 2 JL)( M(Q)) . 
Then, it follows from (2.4.4) and Claim 3.3.3 that 
dw(<f>(f))(u6(Q)) 

= /=T(l + 00))) ( 55J + — - + -4_)„ . « W ) - S 
, r Q 2 m — ld A S m-i\ 

= ^EIr(A Rm u)<S(Q) - 5. 

At the second last equality, we used the formula QS(Q) = 0. In the following 
claim, we shall show S = 0. Now, the proof of (3.3.5) is complete. Hence, 
we have shown Lemma 3.3.1. □ 



Claim 3.3.4. For any u G C^°(IR m+1 \ {0}), we have 

(«l? +2 j|)( fl *< < »)- - 



Proof of Claim 3.3.4- By the Leibniz rule, the left-hand side amounts to 

Hence we see that this equals in light of the formulas: 

Q*(Q)=0, Qjfi6{Q) = -6{Q), Q-^5(Q) = -2-^6(Q). 



□ 
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3.4 Central element Z of fic 

We extend the Lie algebra homomorphism <\> : sl(2,R) — ► so(m + 1,2) (see 
(3.3.2)) to the complex Lie algebra homomorphism <j) : s((2,C) — ► so(m + 
1,C). Consider a generator of so (2, C) given by 

«=-^<«-»-^(- . J)' <-» 

We set 

Z := 0(z) G v^fl. (3.4.2) 
In light of (3.3.2) and (2.1.1), we have 

Z = ^p-(N m+1 - N m+1 ) (3.4.3) 

= \[~ l(^m+l,m+2 — £m+2,m+l)- (3.4.4) 

Hence, yf—\Z is contained in the center c(t) of 6 ~ so(m + 1) © so (2). If 
m > 1, then c(t) is of one dimension, and v 7 — T-^ generates c(t). By (3.4.1), 
we have e^~^ tz = 7 m+ 3 in SOo(m + 1,2) if and only if £ € 2irZ. Hence, 
e V=itz = 1 in G = SOo ( m + l,2j"if and only if t G 4vrZ (see (2.3.1)). 
Therefore, we have the following lemma: 

Lemma 3.4.1. The Lie algebra homomorphism <f> : sl(2,M) — > so(m + 1, 2) 
(see (3.3.1)) lifts to an injective Lie group homomorphism SL(2,M) — > G. 

By the expression (3.4.4) of Z and by the i^-isomorphism (3.2.2), we 
have: 

Lemma 3.4.2. dir + (Z) acts on W a as a scalar multiplication of —(a+ m ^-). 

Combining (3.4.1), (3.4.2), and Lemma 3.3.1, we readily get the following 
lemma: 

Lemma 3.4.3. The differential operator d7r + (Z) takes the form: 

dn+(Z) = \x\(j-l). 

Remark 3.4.4. dn + (Z) coincides with the operator D in Introduction. In 
particular, D is a self-adjoint operator on L 2 (M. m , ^j) because \f—\Z G 
and 7r + is a unitary representation. 
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Remark 3.4.5 (Weil representation). For the Weil representation of G' , 
the Lie algebra homomorphism ip : sl(2,M) — > sp(m, R) (see Remark 3.3.2) 
sends z to 

Hence \J-\Z 1 is a central element oft 1 ~ u(m). T/ie differential operator 
dw(Z') amounts to the Hermite operator (see [16, §6 fc()/j 

V = -(A - |x| 2 ). 

See the table in Subsection 1.4 for the differential operators correspond- 
ing to e, / and h. 

3.5 Proof of Proposition 3.2.1 

This subsection gives a proof of Proposition 3.2.1. 

1) Let us show j a ^) = Urf e L\R m , g) n L 2 (R m , g) for any G 

Jf'(M m ). By the definition (3.2.4) of / a> ,, / 0>J (r) is regular at r = 0, 
and f a ,i(r) decays exponentially as r tends to infinity. Therefore, € 
L 1 (R + ,r' n-2 dr) n L 2 (E + , r m_2 dr). Since our measure g has the form 

P- = r m - 2 drduj, (3.5.1) 
\x\ 

with respect to the polar coordinate (3.2.5), we have shown j a ,i{<t>) £ ^(W 71 , g)H 
L 2 (M"\g). 

2) We set H a j := j a>l (?f'(lR m )) . Obviously, H a j is isomorphic to J{'(lR m ) 
as i?-modules. To see W a j = H a j, it is sufficient to show the following 
inclusion: 

H a ,i C W , (3.5.2) 

because W a ^ is characterized as the unique subspace of W a such that W a j ~ 
JC'(M m ) as ^-modules. 

To see (3.5.2), we recall from (3.2.2) that W a is characterized as the 
unique subspace of L 2 (M m , g) on which dir+(Z) acts with eigenvalue — (a + 

^^-). Thus the inclusive relation (3.5.2) will be proved if we show the 
following lemma: 

Lemma 3.5.1. The operator dir+(Z) acts on H a ^ as a scalar multiplication 
— (a + ^y^)- In other words, we have 

dn+Wifot) = -(a + ?^±)f a , l cf>. (3.5.3) 
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Proof of Lemma 3.5.1. Writing the differential operator dir + (Z) (see Lemma 
3.4.3) in terms of the polar coordinate and using the definition of f a i (see 
(3.2.4)), we see that the equation (3.5.3) is equivalent to 

/ r d 2 m — 1 d Ac m -i / m — 1\\ , , , k . , , , N \ 

\iw + —fr + -ir - - r + ( a + —) J (^y e - 2 >H) = o, 

(3.5.4) 

for ^(r) := L™jf +2i (r). The equation (3.5.4) amounts to 

(4rip"(4r) + (m - 1 + 21 - 4r)V>'(4r) + (a - Z)^(4r)) r l e~ 2r 4>{uj) = 0. 

This is nothing but Laguerre's differential equation (8.1.2) with n = a — 
/, a = m — 2 + 21. Now the lemma follows. □ 

3.6 One parameter holomorphic semigroup n + (e tz ) 

It follows from Lemma 3.4.2 that for i G C the operator 

n + (e tz ) := expdir+(tZ) = ^ -dir+(tZ) j (3.6.1) 

acts on W a i as a scalar multiplication of e~^ a+ ~ 2~~ )* for any < Z < a, 
of which the absolute value does not exceed 1 if Ret > 0. In light of the 
direct sum decomposition (3.2.1), if Ret > then the linear map 7r + (e* z ) : 
L 2 (R m , j^)k —> L 2 (R m , j^)k extends to a continuous operator (we use the 
same notation ir + (e tz )) on L 2 (M. m , ||). Furthermore, it is a contraction 
operator if Ret > 0. We summarize some of basic properties of ir + (e tz ): 

Proposition 3.6.1. 1) The map 

{t e C : Ret > 0} x L 2 (R m , 0) L 2 (R m , 0), (t, /) ^ vr + (e* z )/ 

(3.6.2) 

is continuous. 

2) For a fixed t such that Ret > 0, ir+(e tz ) is characterized as the 
continuous operator from L 2 (R m , ||) — > L 2 (M m , ^) satisfying 

7T + (e tz )u = e^ a+ ^ t u, (3.6.3) 

/or any u G W 0j j = {/ a ,z0 : 4> & "K l (R m )} (see Proposition 3.2.1) and for 
any I, a G N suc/i t/iat < I < a. 
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3) The operator norm ||7r_|_(e* z )|| of ir + (e tz ) is e 2 Re *. 

4) If Ret > 0, ir + {e tz ) is a Hilbert-Schmidt operator. 

5) If t € V^IR, then ir + (e tz ) is a unitary operator. 

Remark 3.6.2. We define a subset T + := {tZ : t > 0} in \J— lg. Propo- 
sition 3. 6. 1 indicates how the unitary representation ir + of G extends to a 
holomorphic semigroup on the complex domain G ■ expr + • G of Gc- Our 
results may be regarded as a part of the Gelfand-Gindikin program, which 
tries to understand unitary representations of a real semisimple Lie group 
by means of holomorphic objects on an open subset of Gc \ G, where Gc is 
a complexification of G (see [10, 27, 29]). 

Remark 3.6.3 (Weil representation). In the case of the Weil represen- 
tation (w,L 2 (R m )) ofG' = Sp{m,RY, the functions f' al (see Remark 3.2.4) 
play the same role as f a j because of the following facts: 

1) {f' a i '■ < I < a} spans a complete orthogonal basis of L 2 (W + ,r m ~ 1 dr) 
(cf. Remark 3.2.2). 

2) For any <p £ K l (R m ), f' al {r)<p{oj) (0 < I < a) are eigenf unctions of 

dw(Z') with negative eigenvalues — (Jj + ! + §)■ 

Owing to these facts, we obtain a holomorphic semigroup of contraction 
operators vo{e tz ') := expt(dw(Z')) (Ret > 0) on L 2 (R m ). Since dw(Z') 
coincides with the Hermite operator T> (see Remark 3.4-5), this holomorphic 
semigroup is nothing but the Hermite semigroup (see [16, §5]). 

4 Radial part of the semigroup 

This section gives an explicit integral formula for the 'radial part' of the 
holomorphic semigroup ■K+(e tz ) in the 'Schrodinger model' L 2 (R m , |x| _1 c?x). 
The main result of Section 4 is Theorem 4.1.1. As its applications, we see 
that the semigroup law 7r_|_(e ( -* 1+ * 2 ^) = ir + (e tlZ ) oir(e t2Z ) gives a simple and 
representation theoretic proof of the classical Weber's second exponential 
integral formula on Bessel functions (Corollary 4.5.1), and that taking the 
boundary value limir + (e sZ ) = id provides an example of a Dirac sequence 

(Corollary 4.6.1). 

Theorem 4.1.1 will play a key role in Section 5, where we complete the 
proof of the main theorem of this article, namely, Theorem 5.1.1 that gives an 
integral formula of the holomorphic semigroup 7r+(e tz ) on L 2 (R m , |x| _1 c?x). 
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4.1 Result of the section 

For a complex parameter isC with Re t > 0, we have defined a contraction 
operator vr + (e* z ) : L 2 (R m , j§j) -► L 2 (M m , g) in Proposition 3.6.1. 

We recall that Z is a central element in he (see Subsection 3.4) and that 
R is a subgroup of K. Therefore, ir + (e tz ) intertwines with the .R-action. 
On the other hand, the natural action of R ~ SO(m) gives a direct sum 
decomposition of the Hilbert space: 

, °° 

L 2 (R m , =-) ~ ^® L 2 (IR + , r m - 2 dr) ^(R m ). (4.1.1) 

Hence, by Schur's lemma, there exists a family of continuous operators 
parametrized by I £ N: 

Tr+,l(e tZ ) : L 2 (R + ,r m - 2 dr) L 2 (M+, r m ~ 2 dr) (4.1.2) 

such that 7r + (e tz ) is diagonalized according to the direct sum decomposition 
(4.1.1) as follows: 

oo 
1=0 

The goal of this section is to give an explicit integral formula of it + j(e tz ) 
on L 2 (M + , r m ~ 2 dr) for I G N. We note that -rr +j i(e tz ) is a unitary operator 
if Ret = because so is ir + (e tz ). Likewise, ir + j{e tz ) is a Hilbert-Schmidt 
operator if Ret > because so is 7r + (e tz ). 

We now introduce the following subset of C: 

n := {t € C : Re t > 0} \ 2tt^1Z, (4.1.4) 

and define a family of analytic functions K^~(r, r'\ t) on R_|_ x R+ x $7 by the 
formula: for I = 0, 1, 2, ... , 

y . 2 -2(r+r')coth| m _ 

Aj (r,r ;f) : = smh . ("O-^W^) 

2m-l+2J e -2(r+r')coth|^ r7 ./y f Ay/rP \ 

= (sinh|)™-i+ 2 ' Im - 2+21 Idnhi J • (4L5) 

Here, /^(z) := (^)~ v I u (z), and /„(z) denotes the /-Bessel function (see 
Subsection 8.5). We note that the denominator sinh| is nonzero for t G Q. 
We are ready to state the integral formula of -K + ^{e tz ) for t G f2: 
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Theorem 4.1.1 (Radial part of the semigroup). 1) For Ret > 0, 

the Hilbert-Schmidt operator ir +i i(e tz ) on L 2 {W + ,r m ~ 2 dr) is given by the 
following integral transform: 

/•oo 

(^ l {e tz )f)(r) = / K+(r,r';t)f(r')r' m - 2 dr'. (4.1.6) 
J o 

The right-hand side converges absolutely for f G L 2 r m ~ 2 dr). 

2) If t G \/^TlR &«< t ^ 2vr v /r lX t/ien t/ie integral formula (4.1.6) /or 
t/ie unitary operator ir + j(e tz ) holds in the sense of L 2 -convergence. Further- 
more, the right-hand side converges absolutely if f is a finite linear combi- 
nation of f a ,i (a = I, I + 1, • ■ ■ ). 

Remark 4.1.2. Let us compare Theorem 4-1-1 with the corresponding result 
for the Weil representation w of G' = Sp{m,M.J realized as the Schrodinger 
model L 2 (R m ). According to the direct sum decomposition of the Hilbert 
space: 



oo 



L 2 (IR m )~^ L 2 (M+,r m - 1 dr)®^(M m ), 

1=0 

there exists a family of continuous operators voi{e tz ) (Ret > 0) such that 
the holomorphic semigroup w{e tz ) has the following decomposition: 

oo 

w(e tz> ) = ^2 ^(e tz ')®id. 

1=0 

Then, by an analogous computation to Theorem 4-1.1, we find the kernel 
function of the semigroup wi{e tz ) is given by 

X ^ = sinhi ^"^^(^hl)- 

The relation between the kernel function % (Mehler kernel) of w(e tz ') 
and Xi(r,r';t) will be discussed in Remark 5.7.2. 

This section is organized as follows. In Subsection 4.3, we give a proof 
of Theorem 4.1.1 for the case Ret > 0, which is based on a computation 
of the kernel function by means of the infinite sum of the eigenf unctions. 
In Subsection 4.4, by taking the analytic continuation, the case Ret = 
is proved. Applications of Theorem 4.1.1 to special function theory are 
discussed in Subsections 4.5 and 4.6. 
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4.2 Upper estimate of the kernel function 

In this subsection, we shall give an upper estimate of the kernel function 
K+(r,r';t). 

For t = x + y/—Ty, we set 

, . sinh x . . 

a * := — , 4.2.1 

cosh x — cos y 

cos U 



' 3 < () = SEI" (4 - 2 - 2 » 



Then, an elementary computation shows 

Recoth^ = a(t), (4.2.3) 

Re— ^-t- = a(t)/3(t). (4.2.4) 
sinh | 

For t G (see (4.1.4) for definition), we have coshx — cosy > 0, and then, 

a(t) > and \/3{t)\ < 1. (4.2.5) 

If Ret > 0, then 

a(t) > 0. (4.2.6) 

For later purposes, we prepare: 

Lemma 4.2.1. If y G R satisfies \y\ < A.yfrr' , then, fort G we /taue the 
following estimate for some constant C : 

l-2(HV)coth ij / V )| < Ce _2a(t)(l-|/3(t)|)(r+r-')_ ( 42 .7) 
" sinh | 

Proof. Using the upper estimate of the /-Bessel function (see Lemma 8.5.1), 

|/,(-4r)|<Ce l?/l1 

smh | 

we have 

-2(r+r') Rccoth Rel — -i-j- I 



| e -2(r-+r')coth|7,_y } | < Cg 
sinh | 



<( ^ e -2(r+r')a(t)+4v / T : ? 7 a(t)|/3(t)| 
<C r e -2a(t)(l-|/3(t)|)(r+r'). 
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Here, the last inequality follows from 

r + r' - 2\(3{t)\^> (1 - \(3{t)\){r + r') (4.2.8) 
for t G fl. Thus Lemma is proved. □ 
Now we state a main result of this subsection: 

Lemma 4.2.2. Let I G N and m > 2. 

1) There exists a constant C > such that 

C ( l\l -2a(t)(l-\l3(t)\)(r+r') 

/or any r, r' G M+ and tEfi. 

2) //Ret > 0, then K+(-,-;t) G L 2 ((M+) 2 , (rr')" 1-2 ^/). 

3) //Ret > 0, then for a fixed r > 0, we have K+(r, ■;<) G L 2 (M + , r'" 1 " 2 ^'). 

Proof. 1) By the definition of (see (4.1.5)), we have 

^^^-Isinh^l-i+^l 6 /m - 2+2i( s]uhT)|- 

Now (4.2.9) follows from Lemma 4.2.1 by substituting v = m — 2 + 21 and 
y = 4 a/ rr'. 

Since a(t) > for Ret > 0, the statements 2) and 3) hold by 1). □ 

4.3 Proof of Theorem 4.1.1 (Case Ret > 0) 

We recall from Remark 3.2.2 that 

fa,l{r)=L i :i l 2+2l {Ar)r l e^ (a = 1,1 + 1, . . .) 

forms a complete orthogonal basis of L 2 (R + ,r rn ~ 2 dr). Further, by the or- 
thogonal relation of the Laguerre polynomials L^(x) (see (8.1.3)), we have 
the normalization of {f a ,i} as follows: 

Lemma 4.3.1. For integers a,b>l, we have 



f 

Jo 



fa,l{ r )fbA r ) r dr = \ r(m-l+a+Q _ , I 4 - 3 - 1 ) 

1 4"»-i+2ir(a-/+i) ija- o. 
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We rewrite (3.2.1) by using Proposition 3.2.1 as follows: 

, oo a 

1 1 a=0 1=0 

oo oo 



©(©^,0 

1=0 a=l 

oo oo 

®((© C /^^(W)- ( 4 - 3 - 2 ) 



=0 a=l 

It follows from Proposition 3.6.1 (2) and the definition (4.1.3) of 7r + j(e tz ) 
that 

■* + Z )fa,l = e-^^Ui (a = I, I + 1, • ■ ■ ). 

Therefore, the kernel function Kf(r,r';t) of ir + j{e tz ) can be written as 
the infinite sum: 

K+(rS;t)-£ (4.3.3) 

Since ir+ : i(e tz ) is a Hilbert-Schmidt operator if Ret > 0, the right-hand side 
converges in L 2 ((]R + ) 2 , (rr') m ~ 2 drdr'), and therefore converges for almost all 
(r,r')G(M+) 2 . 

Let us compute the infinite sum (4.3.3). For this, we set 

<ry;t) == f ^(a - - L-^ (4r)Lr - 2+2;(V)e -( a -0t. 

Then, it follows from (4.3.1) that we have 

K+(r, r'; t) = 4 m - 1+2 V0 / e~ 2(r+r V( /+I! ^ i )'/<r, r'; t). (4.3.4) 

Now, we apply the Hille-Hardy formula (see (8.1.4)) with a = m — 2+2/, n = 
a — l,x = 4r,y = 4r', and w = e~*. We note that \w\ = e~ Rct < 1 by the 
assumption Re t > 0. Then we have 

(4r+4r')e~* m _ 2 

... e i- 6 "* (— 16rr e M 2 +t /2y -16rr'e~* \ 

«(r,r ;t) = f -— ^ j m _ 2+2J (____) 

( rr /)-^i+/ e - 2 (^') T ?£ - ! r e (^+0t ,4^ 



T"g v ' 1 — e~ l gV 2 TV" /4vn \ 

4— 2+2/(1 _ e -t) Im ' 2+2L V^hl J ■ 
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Hence, the formula (4.1.5) is proved. 

Therefore, the right-hand side of (4.1.6) converges absolutely by the 
Cauchy-Schwarz inequality because K^~(r,r';t) G L 2 (§L+,r' m ~ 2 dr') for any 
r > and Ret > (see Lemma 4.2.2 (3)). 

Remark 4.3.2. The special functions and related formulas that arise in the 
analysis of the radial part have a scheme of generalization from SL(2,M.J 
to G = SOo(m + 1,2J~ and G' = Sp(m,IR)^ This scheme is illustrated as 
follows: 

SL(2,RJ GorG' 
Segal-Shale-Weil representation =^ minimal representation 
Hermite polynomials =^ Laguerre polynomials 

Mehler's formula =^ Hille-Hardy formula 

See [17, p 116, Exercise 5 (d)] for the SL(2,M.) case. Owing to the reduction 
formula of Laguerre polynomials to Hermite polynomials (see (8.2.1) and 
(8.2.2) ), the radial part f' a i(r) (see Remark 3.2.4) f or the Weil representation 

of G' = Sp(m,M.y collapses to a constant multiple of H2 a -i(r)e 2 (/ = 0, 1) 
if m = 1 . 

Remark 4.3.3. In [24, Chapter 2], W. Myller-Lebedeff proved the following 
integral formula: 

r 00 

/ ^(r,r';f)/ a ,i(r')r' m - 2 <ir' = e-( a+! ^'Va,((r) for a > I > 0. (4.3.5) 
Jo 

In view of (4.1.3) and Proposition 3.6.1 (2), the formula (4.1.6) in Theorem 
4-1.1 implies (4.3.5) and vice versa. The proof of [24] is completely different 
from ours. Here is a brief sketch: For the partial differential operator 

L &2 a + 1 3 13 a 

dx 2 x dx x dt 

one has the following identity using Green's formula, 

If I du dv ct ~t~ 1 ■ 

/ / (vLu — uL*v)dtdx = / (v— u— — I uv)dt H — uvdx, (4.3.6) 

JjD JdD ox ox x x 

for a domain D C M 2 . Here, L* denotes the (formal) adjoint of L. Now, 
we take u(x,t) := t n L^),v(x,t) := (|)f -^ e -f^/ a (^), n G N,r,£ G 
IR as solutions to Lu = 0,L*v = respectively, and the domain D as a 
rectangular domain D := {(x,t) G M 2 : < x < 00, t\ < t < £2} for some 
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t\,t2 G R. T/ien fry the decay properties of u and v, the integrands in the 
right-hand side of (4.3.6) vanish on x = and x = oo. Since the integral 
of the left-hand side of (4.3.6) vanishes, the integral J °° \u(x, t)v(x, t)dx 
becomes constant with respect to t. By taking the limit t — > r, we have 
lim t _,. r J °° ^u(x, t)v(x, t)dx = u(£,r) since v(x,t) is proved to be a Dirac 
delta function. Hence we obtain 

/•oo 1 

/ — u(x, t)v(x, t)dx = u(£, r), 
Jo x 

which coincides with (4.3.5) by a suitable change of variables. 



4.4 Proof of Theorem 4.1.1 (Case Ret = 0) 



Suppose t G \J — 1R. Then, ir + i(e ) is a unitary operator on L 



Suppose furthermore t £ c ln\f^YL. For e > and / £ L (1 



„m-2 



„m-2 



dr). 
dr), we 



have from Theorem 4.1.1 (1) 



(e+t)Z 



)/ 



K+(r, r';e + t)f{r')r' m - 2 dr'. 



By Proposition 3.6.1 (1), the left-hand side converges to ir +t i(e )f in L (R+, r m dr) 
as e tends to 0. For the right-hand side, we have: 

Claim 4.4.1. For t G ^TR \ 

f'QO f'OO 

hm / K+(r, r'; e + t)f a ^r')r' m - 2 dr' = / K+(r, /; t)f a ^r')r' m - 2 dr' 
£ l° Jo Jo 

and the right-hand side converges absolutely. 
Proof. If e G R and f G v^R then 



sinh 



sinh — 
2 



+ 



sinh — 
2 



Therefore, it follows from (4.2.9) that 
\K+(r,r';£ + t)\ < 



C(rr 



> 



sinh — 
2 



sinh|| m - 1+2 ' 



if £ > and £ G v / — 1R \ 2tt\T^ TZ, because e + i G f2 implies a(e + i) > 
and \(3(e + t)\ < 1. Therefore, we have 



/\ /m— 2 1 



< 



Cr l 



jl+m-2 „-2r' \ jjn-2+Al 



a— I 



! (V)| 



sinh|| m - 1+2i 



By the Lebesgue convergence theorem, we have proved Claim. 



□ 
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Since linear combinations of faj span a dense subspace of I? (R+ , r m 2 dr) , 
2) is proved. □ 

4.5 Weber's second exponential integral formula 

From the semigroup law: 

vr + (e ( * 1+ * 2)z ) = TT+{e tlZ ) oTT + (e t2Z ) (Reti,Ret 2 > 0), (4.5.1) 

we get a representation theoretic proof of classical Weber's second exponen- 
tial integral for Bessel functions (see [33, §13.31 (1)]): 

Corollary 4.5.1. (Weber's second exponential integral) Let v be a 

positive integer, and p,a, (3 > 0. We have the following integral formula 

J™ e'^ J v {ax)J v {(3x)xdx = l e xp(-^±^)l i ,(|^). (4.5.2) 

Proof. It follows from the semigroup law (4.5.1) that the integral kernels for 
7r + (e ( - tl+t2 ^ z ) and 7r + (e tlZ ) o ■K + (e t2Z ) must coincide. Then, from Theorem 
4.1.1, we have 

/•oo 

/ K+(r,s;t 1 )K+( S ,r';t 2 )s m ~ 2 ds = K+(r,r';t 1 + t 2 ). (4.5.3) 
Jo 

In view of (4.1.5), the formula (4.5.2) is obtained by (4.5.3) by the change 
of variables, 



x 



7T y" — 1 7T y/— 1 , 

4e 2 yV 4e 2 yV 



= y/s, a= — —j , P= —j- — , v = m-2 + 2l, 

smh -± sinh 



p = 2^coth + coth 



□ 



4.6 Dirac sequence operators 

We shall state another corollary to Theorem 4.1.1. Let v be a positive 
integer, x,i/£R,s£C such that Re s > 0. For a function / on R, let T s be 
an operator defined by 



/•oo 

7 s :f(x)^ A(x,y;s)f(y)dy, 
Jo 



32 



with the kernel function 

-§(rr 2 -H/ 2 )coths / xv \ 

A(X , KS) : _ ainhj ,,(_£.). (4.6.1) 

Then we have the following corollary. 

Corollary 4.6.1. 1) XTie operators {7 S : Res > 0} form a semigroup of 
contraction operators on L 2 (R + ,dx). 

2) (Dirac sequence) lim^o ||^s^ ~~ ^llL 2 (R + ,dx) = holds for all h G 
L 2 (R + ,dx). 

Remark 4.6.2. For sufficiently small s, the semigroup {7 S : Res > 0} 
behaves like the Hermite semigroup (see [16]) whose kernel is given by the 
following Gaussian (cf. (1.2.2)): 

K(x,y;s) = e 2 cottls + si n hs 2 cottls 

V 2vr sinh s 

because I v (z) ~ ^= e z /or sufficiently large z (see [33, $7.23] for the asymp- 
totic behavior of l v [z)). Note that it is stated in [16, §5.5/ that the Hermite 
semigroup forms a 'Dirac sequence '. 

Proof. Since we assume v is a positive integer, v = m — 2 + 21 for some 

2 2 

m > 3 and I G Z. We change the variables r = r / = ^-,t = 2s and 
define a unitary map 

9 

-t» 2m — 3 t* 

$ : L 2 (R + ,r m - 2 dr) L 2 (R+, dx), (<&/)(*) := (-)^-/( T ). (4.6.2) 

Comparing (4.6.1) with (4.1.5), we have 

$- 1 oT,o$/ = vr +ii ( e 2sZ )/ (4.6.3) 

Thus by Theorem 4.1.1 (1), 1) is proved. 

2) We take a limit s [ of (4.6.3). By Proposition 3.6.1 (1), the right- 
hand side equals /. Hence by putting h := we have lim^o 7 s h = h. □ 



5 Integral formula for the semigroup 

In this section, we shall give an explicit integral formula for the holomorphic 
semigroup exp(td7r + (Z)) = Ti + (e tz ) on L 2 (R m , ^j) for Ret > 0, or more 

precisely, for t € SI = {t G C : Ret > 0} \ 2vr v /z TZ (see (4.1.4)). The main 
result of this section is Theorem 5.1.1. In particular, we give a proof of 
Theorem A in Introduction. 
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5.1 Result of the section 



Let (x, x') be the standard inner product of IR m , \x\ := (x, x) be the norm. 
We recall the notation from Subsection 1.1: 

ip(x,x') := 2y / 2(|a;||x / | + (x,x'}) = A\x\^\x'\2 cos -, (5.1.1) 

where 9 = 0(x,x') is the angle between x and x' in M. m . Let us define a 
kernel function K + (x, x';t) on M. m x R m x $7 by the following formula as in 
Introduction: 

2 ^ e ~2(N+M)coth| ^ ,M XiX > 

K + (x,x;t) := m+1 ^(x,x) ^Irn^z[—^-j 

2 



sinh" | 2 v sinh 5 



2e -2(|x| + |x'|)coth| _ ^( X ,xf 

7T— sinh" 1 " 1 | 2 V smh 2 



where ^(2) is the modified Bessel function of the first kind and I v (z) := 
(I) - " Iv{z) is an entire function (see Subsection 8.5). We note that sinh | in 
the denominator is non-zero because t 2tt\/— YL. Therefore, K + (x,x';t) 
is a continuous function on W m x R m x fl 

We recall from Proposition 3.6.1 (3) that ir + (e tz ) is a contraction opera- 
tor with operator norm ||7r + (e* z )|| = e ~ Rc *. Here is an integral formula 
of the holomorphic semigroup ir + (e tz ): 

Theorem 5.1.1 (Integral formula for the semigroup). 1) For Ret > 0, 

-K + (e tz ) is a Hilbert-Schmidt operator on L 2 (M. m , g), and is given by the 
following integral transform: 

{7r + {e tz )u)(x)= [ K + {x,x';t)u{x')p- for u G L 2 (R m , 7— h- (5.1.3) 

JR m \ x \ \ x \ 



Here, the right-hand side converges absolutely. 

2) For t e y/^TR, TT + (e tz ) is a unitary operator on L 2 (M. m , jfj). // 

t £ y/— 1R but t ^ 2tt\/— YL, then the right-hand side of (5.1.3) con- 
verges absolutely for any u £ L^iW 11 ,^) n L 2 (M m , g), in particular, for 

any K -finite vectors in L 2 (R m , g). Since K -finite vectors span a dense 

subspace 0/ L 2 (M m , g), i/ie integral formula (5.1.3) /toWs m i/ie sense 0/ 

I? -convergence. 



Remark 5.1.2 (Realization on the cone C+). Via the isomorphism 
L 2 (C + ) ~ L 2 (M m , g) fsee Subsection 3.1), the above formula for L 2 (R m , jfj) 
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can be readily transferred to the formula of the holomorphic extension ir + (e tz ) 
on L 2 (C + ). For this, we define a continuous function K + ((,£';t) on C + x 
C + x Q by the following formula: 

(5.1.4) 

where \(\ := y^C) = (Ci + • • • + C+i)^ • ™en ; 

(Tr + (e tz )u)(() = [ K^(C,(';t)u(C')dK£) forueL 2 (C + ). (5.1.5) 
■/c + 

Remark 5.1.3 (Weil representation). For the Weil representation w 
of G' , the corresponding semigroup of contraction operators is the Hermite 
semigroup {w{e tz ) : Ret > 0} (see Remark 3.6.3), whose kernel function 
is given by the Mehler kernel X(x,x';t) (see Fact C in Subsection 1.2; see 
also [16, §5]). 

The rest of this section is devoted to the proof of Theorem 5.1.1. Let 
us mention briefly a naive idea of the proof. We observe that the action of 
K{= SO(m + 1) x SO{2j) on L 2 (R m , g) is hard to describe because K 
does not act on M. m . However, the action of its subgroup R = SO(m) has a 
simple feature, that is, we have the following direct sum decomposition: 

oo 

L 2 (R m , ~ L 2 {^+,r m - 2 dr)®M l (R m ). (5.1.6) 

We have already proved in Theorem 4.1.1 that Kf(r,r';t) is the kernel of 
7r +) l(e tz ) which is the restriction of ir + (e tz ) in each /-component of the right- 
hand side of (5.1.6). Theorem 5.1.1 will be proved if we decompose K + into 
K(~ . This will be carried out in Lemma 5.6.1. An expansion formula of K + 
by K(~ is not used in the proof of Theorem 5.1.1, but might be of interest 
of its own. We shall give it in Subsection 5.7. 

5.2 Upper estimates of the kernel function 

In this subsection, we give an upper estimate of the kernel function K + (x, x'; t) 
That parallels Lemma 4.2.2. 

Lemma 5.2.1. Let m > 2. 1) There exists a constant C > such that 

\K + {ruyj;t)\ <- ^-—e-^Wa-l/JWDCr+r'), (5.2.I) 

|sinh|| m 1 
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for any r,r' G R + , u>,u>' G S' m 1 , and t G 0. _£Tere, a(t),f3(t) are defined in 
(4.2.1) antt (4.2.2), respectively. 
2) If Ret > 0, then 



OO. 



3) If Ret > 0, then for a fixed x G M m , we have K+(x,- ;t) G L 2 (M m ,g). 
Proof. By the definition (5.1.2) of K + (x, x' ;t), we have 



|A" + (rw,r'cy;t)| 



2 e -2(r+r')coth § 

m — 1 + 

n~ \ smh ^l" 1 " 1 



I m — Z 

2 



ip(ruj, r'uj' 
sinh | 



By (5.1.1), we have \ip(ru, r'u')\ < 4vrr'. Applying Lemma 4.2.1 with 



TO- 3 



, we have 



\K + (rw,r'u/;t)\ < 



2Ce - a (t)(l-\/3(t)\)(r+r') 

7r a | sinh|| m 



Replacing C with a new constant, we get (5.2.1). 

The second and third statements follow from (5.2.1) because a(t) > 
and \(3(t)\ < 1 if Ret > 0. □ 



5.3 Proof of Theorem 5.1.1 (Case Ret > 0) 

Suppose Ret > 0. We set 

f dr' 
(S t u)(x):= K + (x,x';t)u(x')^-. (5.3.1) 

JR m \ x I 

By Lemma 5.2.1 (2), we observe that St is a Hilbert-Schmidt operator on 
L 2 (R m , g), and the right-hand side of (5.3.1) converges absolutely for u G 

L 2 (M. m , g) by the Cauchy-Schwarz inequality and by Lemma 5.2.1 (3). 

The remaining assertion of Theorem 5.1.1 (1) is the equality ir+(e tz ) = 
St- To see this, we observe from the definition (5.1.2) of K + (x,x';t) that 

K + (kx, kx'; t) = K + (x, x; t) for all k G R. 

Therefore, the operator St intertwines the i?-action, and preserves each 
summand of (4.1.1). In light of the decomposition (4.1.3) of the operator 
ir + (e tz ), the equality ir + (e tz ) = St will follow from: 
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Lemma 5.3.1. Let Ret > 0. For every I G N, we have 

K+,l(e tZ ) (g> id = 5't|L2(R + ,r m - 2 dr)cg)^(R m )- (5.3.2) 

We postpone the proof of Lemma 5.3.1 until Subsection 5.6. 
Thus, the proof of Theorem 5.1.1 (1) is completed by admitting Lemma 
5.3.1. 

5.4 Proof of Theorem 5.1.1 (Case Ret = 0) 

Suppose Ret = 0. Then, by Lemma 5.2.1 (1), we have 

C 



\K + (x,x';t)\ < 



sinhf I™" 1 



because a(t) = 0. Therefore, the right-hand side of (5.1.3) converges abso- 
lutely for any u G L l (R m , g) n L 2 (R m , g), as is seen by 

f \K + (x,x';t)u(x')\f^<- ^r—r[ Kx')£<oo. 

V 1 V J K J] \x'\ ~ IsinhH™- 1 J Rm l V Jl \x'\ 

By Proposition 3.2.1 (1), we have L 2 {R m ,^) K C L 1 (R m , g). Hence, 
the right-hand side of (5.1.3) converges absolutely, in particular, for if -finite 
functions. 

Finally, let us show the last statement of (2). Since W a> i(0 < I < a) 

dx ' 

N- 



spans L 2 (R m , &) K (see (3.2.1)), it is sufficient to prove 



7r + {e tz ) = S t on W a ,i (0 < / < a). (5.4.1) 
We recall from Proposition 3.2.1 that every vector u G W a j is of the form 

«M = fa,l(r)H") (5-4.2) 

for some (f> G 3-C'(M m )(see (3.2.4) for the definition). Suppose e > and 
t G v 7 -!^ \ 27r v /r TZ. As in the proof of Claim 4.4.1, we have 

C 

\K + (x,x;e + t)\< 



sinhH™- 1 



and therefore 

,m-2, , y ~ jT e l-^a-i 



Cr' m - 2+l e- 2r '\L™- 2+2 \±r') 



2 
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Here, C := C max ueS m-i |^(^)|- Hence, by the dominated convergence 
theorem, we have 

\im S £+t u = S t u 

e|0 

for any u G W a ,i- 

On the other hand, by Proposition 3.6.1 (1), we have 

lim^+(e (£+ * )Z )n = Ti + {e tz )u. 
Since ir + (e( £+t ^ z ) = S £+t for e > 0, we have now proved (5.4.1). 

5.5 Spectra of an 0(m)-invariant operator 

The rest of this section is devoted to the proof of Lemma 5.3.1. 

The orthogonal group 0(m) acts on L 2 (S m ~ l ) as a unitary representa- 
tion, and decomposes it into irreducible representations as follows: 

oo 
1=0 

Since this is a multiplicity-free decomposition, any 0(m)-invariant operator 
S on L 2 (S m ~ 1 ) acts on each irreducible component as a scalar multiplication. 

The next lemma gives an explicit formula of the spectrum for an 0(m)- 
invariant integral operator on C(S m ^ 1 ) in the general setting. This should 
be known to experts, but for the convenience of the readers, we present it 
in the following form: 

Lemma 5.5.1. For a continuous function h on the closed interval [—1,1], 
we consider the following integral transform: 

Sh : L?(S m ^ 1 ) — ► L 2 (S' m_1 ), / h((u,u'))4>{u')duj'. (5.5.1) 

Then, acts on < K l (W n ) by a scalar multiplication of c^ m (h) G C. The 
constant c^ m (h) is given by 

om-2 — | _ m-2 

%m{h) = - ( - / /i(cos0)C, 2 (costf)sin"- 2 ^, (5.5.2) 

where C l 2 (x) denotes the normalized G eg enbauer polynomial (see (8.3.2)). 
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Example 5.5.2 (see [15, Introduction, Lemma 3.6]). For h(x) := 
e^~^ x , ci :Tn (h) amounts to 

c l>m {h) = (2tt)t e^A^ J™_2 +i (A). 

Example 5.5.3. We set I v (z) = I u (z) (see (8.5.6)). For h(s) := 

I m-3 (ct-y/I + s), we /joue 

c, m (/i) = 2^7r I! ^V m+2 / m _ 2+2/ (v / 2a) (5.5.3) 



Proof of Example 5.5.3. We apply Lemma 8.5.2 with ^ = Then, we 

have 

/ J m - 3 (aVl + cose)C, 2 (cos0)sin m - 2 #cifl 
Jo 2 



= a< L 2f! ^m-2+2l(V^a). 

Hence, (5.5.3) follows from Lemma 5.5.1. □ 

Proof of Lemma 5.5.1. 1) The operator Sh intertwines the 0(m)-action be- 
cause h({ku>,kuj')) = h((uj,uj')) for k G 0(m). Hence it follows from Schur's 
lemma that Sh acts on each irreducible 0(m)-subspace !K'(R m ) by the mul- 
tiplication of a constant, which we shall denote by ci ;7n (h) for I = 0, 1, 2, 

Thus, we have 

(S^)M = q, m (/O0M for € M l (R m ). (5.5.4) 
To compute the constant ci jTn (h), we use the following coordinate: 
[0,vr) x S m ~ 2 -► (0,7/) ^ w = {cos6,sm9-r]). 

With this coordinate, we have duj = sin" 1-2 OdOd-q. 

^ m-2 

We set wo = (1,0, ■■■ ,0). Now, we take <j>(u) := C { 2 ((u,Uo)) G 
IK'(M m ), which is an 0(m — l)-invariant spherical harmonics. Then the 
equation (5.5.4) for uj = ujq amounts to 



m — 1 



— t~~~ / h(cos9)C, 2 (cos0)sin m z 0d8 = ; =-^< 

r(^)7 ' 2™- 3 /!r(^r±) 



m— 1 



because vol(5 m - 2 ) = and 0("o) = 2 (1) = 2 r^™~ffi (see 

(8.3.3)). Hence, (5.5.2) is proved. " □ 
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5.6 Proof of Lemma 5.3.1 

This subsection gives a proof of Lemma 5.3.1. 

We recall from Theorem 4.1.1 (1) that the kernel function of it + j(e tz ) 
is given by K^(r,r';t) (see (4.1.5) for definition). Therefore, the equation 
(5.3.2) is equivalent to the following equation between kernel functions: 

Lemma 5.6.1. For <p G jK l {R m ), we have 

-[ K + (ruj,r'u;';t)(f>(uj')dLu' = K+(r,r';t)(f>(uj). (5.6.1) 
2 Js™- 1 

Proof of Lemma 5.6.1. We set 

h{r, r', t, s) := I m - 3 ±- f '- . 5.6.2 

vrVsinh" 1 - 1 ! — V Sinh ^ / 

By the definition (5.1.2) of K + (x,x';t), we have 

K + (ruJ, r'J; t) = h(r, r',t, (u, u/)). 

Consider now the integral transform S^y^ on L 2 (S n ~ l ) with kernel 
h(r,r',t, (to, to')). Then it follows from Example 5.5.3 with a = that 

c l , m (h(r,r',t,-))=2K+(r,r';t). (5.6.3) 
Then, (5.6.1) is a direct consequence of Lemma 5.5.1. □ 

5.7 Expansion formulas 

We recall that the kernel functions for the semigroups ir + (e tz ) and it + j(e tz ) 
are given by K + (ru,r'uj';i) and (r,r' ;t). In this subsection, we shall 
give expansion formulas for K + (rLU,r'uj';t) arising from the decomposition 
(see (4.1.3)) 

oo 

* + (e tZ )= ^ ffi vr + ,(e tZ )®id. 
1=0 

Proposition 5.7.1 (Expansion formulas). Let m > 1. 

1) The kernel function K + (x,x';t) (see (5.1.2)) has the following expan- 
sion: 

^(™,rV;£) = -^(— +I)ir+(r,rV)C i 2 «u,,u/)). (5.7.1) 
712 i=o 2 
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2) The special value t = tx\J — 1 for (5.7.1) yields the expansion formula 
for the Bessel function: 

^-i(^cosf) = ^f j (u + l)(-iy^±^ldncos9) (5.7.2) 
Z V7r i=o z 

for z £R + ,v £ |Z. 

Remark 5.7.2 (Weil representation, Gegenbauer's expansion). Let 

us compare the above result with the case of the Weil representation of G' . 
Then, by a similar argument to the proof of Proposition 5.7.1, we can show 
that the Mehler kernel X (see Subsection 1.2) has the following decomposi- 
tion: 

i 22. ra — 2 ~ m-2 
K( ra ,,rV;t) = -^r^(— - + l)X l (r,r';t)C l 2 «u,,u/)) (5.7.3) 

2712 l=t 2 

if m > 1 . 

In light of the formula (see Subsection 1.2) 

3C(rw,r'w';7r>/=I) = ^^e-V^WW) 

(2vr^/^T)T 

the special value at t = 7T\/— T for (5.7.3) yields the following expansion 
formula for the exponential function known as Gegenbauer's expansion ([9], 
see also [33, Chapter XI, §11.5]): 

e ^T 2 cos^ = (y + m)^T Jv+m } z) C£(cos <f>) (5.7.4) 

m=0 Z 

for z G 1, i/ G ^Z. T/iis formula corresponds to (5.7.2). 
If m = 1, we have 

X(x,x';t) = ^(X (\x\,\x'\;t) id(x) + Xi(\x\,\x'\;t) sgn(x)) , (5.7.5) 

which is immediately verified by the formulas for Xq, X\ and X (see Remark 
4.1.2). 

Proof of Proposition 5.7.1. 1) First we prepare a lemma. 

Lemma 5.7.3. Let f £ C[— 1,1]. TTten / is expanded into the infinite 
series: 

/(*) = — ™ E(-o- + 0<*,m(/)C, 2 (*), (5.7.6) 
27r2 ^ 2 

where Q >m (/) is i/ie constant defined in (5.5.2). 
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Proof of Lemma 5. 7.3. Applying the expansion formula f{x) = YlkLo (f)^i{ x ) 
(see (8.3.5)) with v = **=2, we have 

m-2 ( m-2 i A 

«i 2 (/) = I Z *Af), (5.7.7) 

Z7T 2 

from (5.5.2) and (8.3.6). Hence, we get the lemma. □ 

Let h(r,r',t,s) be as in (5.6.2). We recall from (5.6.3) 

c l , m (h(r,r',t,-)) = 2K+(r,r';t). 

Therefore, by Lemma 5.7.3, we get (5.7.1). 
2) Substitute t = 7T\/— T and put 

m-2 



z:=l6rr', cos0 := (u,u}'), v = 



2 ' 

we get (5.7.2). □ 

6 The unitary inversion operator 

6.1 Result of the section 

We define the 'inversion' element wo € G by 

Then, clearly, wq has the following properties: 

1) wo is of order four. 

2) w normalizes M max A and Ad(u> )n max = n 51 ^. 

3) The group G is generated by _P max and wq. 

We note that if m is odd then e ny ^ z is equal to ^ ^ hi 

SO (m+ 1,2) =G/{l, V }. 

This section gives an explicit integral formula of the unitary operator 
tt + (u> ) on L 2 (R m , g). In light of w = e 71 ^ 2 and iry/^T e Q, we define 

the following kernel functions by substituting t = 7r\/— T into (5.1.2) and 
(4.1.5), respectively: 

K + (x,x') := K + (x,x';ttV^1) 

9 m-3 

-72(^0 2 J^(2 A /2(^C 7 )), (6.1.1) 



m — 1 l T m — ± v \ j / 3 / — . 



K+(r,r') := K+(r, r'; ttv^I) 

= 2(-l) i e-^^ T (rr / )- 2 ^ J m _ 2+2I (4v^ 7 ). (6.1.2) 
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Then, the following result is a direct consequence of Theorems 5.1.1 and 
4.1.1. 

Theorem 6.1.1 (Integral formula for the unitary inversion opera- 
tor). The unitary operator ir + (wo) ■ L 2 (W n , ^j) — > L 2 (R m , ^) is given by 
the following integral transform: 

(Tu)(x):= f K + {x,x')u{x')p- u G L 2 (R m , j—r)- (6.1.3) 

Here, the integral (6.1.3) converges absolutely for any u G L^R™, g) n 
L 2 (R m , ||), in particular, for any K-finite vector, hence the equation (6.1.3) 
holds in the sense of L 2 -convergence. 

The substitution of t = 7T\/— T into (4.1.3) gives the decomposition 

oo 

n + (wo)=^2 n +,i( w o) ® id. 

2=0 

As 7r + (wo) is given by the kernel K + (x,x'), so is it + j(wo) by Kf(r,r'). 
Thus, we have: 

Theorem 6.1.2 (Radial part of the unitary inversion operator). The 

unitary operator 7r +j /(u>o) : L 2 (R+, r m ~ 2 dr) — > L 2 (R + , r m ~ 2 dr) is given by 
the following integral transform: 

POO 

(T,/)(r):= / K+(r,r')/(r')r /m - 2 d/. (6.1.4) 

JO 

i/ere, i/ie integral (6.1.4) converges absolutely for any f € L 1 (E. + ,r m ~ 2 dr)n 
L 2 (R + ,r m ~ 2 dr). In particular, the equation (6.1.4) holds in the sense of 
L 2 -convergence. 

Remark 6.1.3 (Weil representation). In the case of the Weil represen- 
tation w of G' , the counterparts of Theorem 6.1.1 and Theorem 6.1.2 can 
be stated as follows: let ojq := e 7rv/ ~ Tz '. 

We define kernel functions X and X[ by the formulas 

X(x,x') :=X(x,x'-ir^) = l—^-^*.* 7 ), 

(271^/^1)^ 

m-l + 2i m-2 

%i{r,r') :=Xi{r,r';TrV^l) = V^l 2 (rr'Y~ J m -2+n (rr'). 
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Then, 

1) The unitary operator w(wq) : L 2 (M. m ) — > L 2 (M. m ) is given by 

(w{wq)u){x) = I X(x, x')u{x')dx' . 

JK. m 

Hence we see that w{wq) is nothing but the Fourier transform. 

2) The 'radial' part of w(wq), namely, the unitary operator wi{wq) : 
L 2 (R + ,r m ~ 1 dr) — ► L 2 (R + , r m_1 dr) (see Remark 4.1.2) is given by 

POO 

{w l {w )f){r)= / XiMfirY^dr'. 
Jo 

6.2 Inversion and Plancherel formula 

It follows from (3.6.3) that tt(w ) 2 = ir + (e 2n ^ z ) = (-l) m+1 id. Thus, as 
an immediate consequence of Theorem 6.1.1, we have: 

Corollary 6.2.1. The integral transform 

T:u{x)^ [ K + (x,x')^-dx', 

JR m \ x I 

m — 1 . m — 3 

K + {x,x ) := m _x j= 7^^J^W( X , X )) 

is a unitary operator on L 2 (M m , of order two (m: odd) and of order four 
(m: even), that is, we have: 

(Inversion formula) T _1 = (-l) m+1 T, 

(Plancherel formula) ||T-u|| L2 ™m dx\ = \\u\\ L 2 mm dx\ for all u G L 2 (IR m , — ). 

\ ' \x\ i >■ ' \x\ ' \X\ 

Remark 6.2.2 (Weil representation, see [16, Corollaries 5.7.3 and 
5.7.4])). Let us compare Corollary 6.2.1 with the corresponding result for 
the Schrodinger model L 2 (M. m ) of the Weil representation w. The unitary 
operator vj{wq) corresponding to the "inversion element" wq is given by the 
(ordinary) Fourier transform 5F (see Fact D in Subsection 1.2). As is well- 
known, "J is a unitary operator of order four. This reflects the fact that 
Wq = e in Sp(m, Wy. 
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6.3 The Hankel transform 

Similar to Corollary 6.2.1, from the equality ir + (wo) 2 = ( — l) m+1 id and 
Theorem 6.1.2, we have: 

Corollary 6.3.1. Letv be a positive integer, andx,y € K. Then the integral 
transform 

f-OO 

7 V : f{x) i ^ / J v {xy)f(y)y/xydy 
Jo 

is a unitary operator on L 2 ((0,oo),dx) of order two. Hence we have: 
(Inversion formula) T" 1 = T u , 

(Plancherel formula) \\7 u f\\ L 2 (R+jdx) = \\f\\ L ^R + ,dx)- 

Remark 6.3.2. The unitary operator 7 U coincides with the Hankel trans- 
form (see [7, Chapter VIII]) and the property 7 2 = id in the corollary cor- 
responds to its classically known reciprocal formula due to Hankel [13] (see 
also [7, §8.1 (1)], [33, §14.3 (3)]). The Parseval-Plancherel formula for the 
Hankel transform goes back to Macaulay-Owen [25]. 

Proof of Corollary 6.3.1. Since we assume v is a positive integer, v = m — 
2 + 21 for some m > 3 and / £ Z. We change the variables r = r 1 = 

\ and define a unitary map <I> : L 2 (R + ,r m ~ 2 dr) — ► L 2 (R), ($/)(x) : = 
(f) 22r ^ i /(^). Then, we have 7 V = e -('+ I2 f i ) 7r v^T$ Tj $-1. Sincc 
T x = tt + j(w ) by Theorem 6.1.2, T, has its inverse as Tf 1 = {-l) m+l T u 7 V 
has its inverse given by 

Hence, the corollary follows. □ 

6.4 Forward and backward light cones 

So far, we have discussed only the irreducible unitary representation 7r + 
realized on L 2 (C+) for the forward light cone. In this subsection, let us 
briefly comment on (7r_, L 2 (C_)) for the backward light cone and (ir, L 2 (C)) 
forC = C+UC_. 

Since di:-{Z) = — di: + (Z) in the polar coordinate representation, we can 
define a semigroup of contraction operators {-7r_(e* 2 ) : Ret < 0} similarly 
on L 2 (C-). All the statements about the semigroup Tr+(e tz ) also hold by 
changing the signature i — > — f and replacing C + by C_ . 
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We define a function K((, £') on C x C by 




(6.4.1) 



Here we note: 



{(CO G C x C : (CO > 0} = (C+ x C+) U (C_ x C_). 

Originally, K+(CO was defined on C + x C+ (see (6.1.1)). Since # + (CO 
depends only on the inner product (CO> we can define lf + (CO al so on 
C_ x C_. 

Corollary 6.4.1. The unitary operator ir(wo) ■ L 2 (C) — ► L 2 (C) coincides 
with the integral transform defined by 



Remark 6.4.2. VFe note t/iat t/ie kernel function K((, (') is supported on 
the proper subset {((,(') G Cx C: (C O > 0} ofCxC. More generally, in 
the case of the minimal representation of 0(p, q) with p + q : even, > 8, we 
shall see in [20] that the integral kernel K Ptq ((, O representing the inversion 
element is also supported on the proper subset {((,(') 6 Cx C : (C C) ^ 0} 
if both integers p, q are even. This feature fails if both p, q are odd. In fact, 
the support of K p<q is the whole space C x C then. 



7 Explicit actions of the whole group on L 2 (C) 



Building on the explicit formula of tt(wo) = ir^e 71 *^ 2 ) on L 2 (C) (see Corol- 
lary 6.4.1) and that of 7r(g) (g G P max ) (see Subsection 2.2), we can find an 
explicit formula of the minimal representation for the whole group G. 

For simplicity, this section treats the case where m is odd. The main 
result of this section is Theorem 7.2.1 for the action of 0(m + 1, 2). 

7.1 Bruhat decomposition of 0(m + 1,2) 

We recall the notation in Subsection 2.1. In particular, P max = M max AN max 
is a maximal parabolic subgroup of 0(m + 1,2). Hence, 0(m + 1,2) is 
expressed as the disjoint union: 




(6.4.2) 



0(m + 1, 2) = P max H pmax WQ pmax 



= pmax JJ jV max AM max 



w N max . 
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We begin by finding a, b G M m+1 , t G R and m G M max such that 

g = n b e tE mw n a G N max AM max w N max (7.1.1) 



holds for g £ P max . 

Suppose 5 is of the form (7.1.1), and we write m = 5m + (5 = ±l,m+ G 
Mf H ). Then, in light of the formulas (2.1.3)-(2.1.5), we have 

g(eo ~ e m+2 ) = n b e tE (5m + )w n a (eo - e m+2 ) 
= n b e tE (5m + )w (e - e m+2 ) 
= n b e tE (5m + )w (e - e m+2 ) 
= 5e*n fe (e + e m+2 ) 

= be 1 \1 - Q(b),2b u . . . , 2b m+l , 1 + Q(6)). (7.1.2) 

Now, we set 

x = \x , . . . , x m+2 ) := g(e - e m+2 ). (7.1.3) 
Then, solving (7.1.2), we have 

x + x m+2 = 25e\ 

5? = bj (1 < j <m + l). 

x Q + x m+2 

Likewise, if we set 

y = %yo, ■ ■ -,ym+2) ■= g~ l {eo - e m+2 ), (7.1.4) 

the following relation: 

= -Oj (1 < j < m + 1) 



yo + 2/m+2 



must hold, because g~ l = n- a e tE (wom~ 1 WQ 1 )won- b . 

Let ( , ) denote the standard positive definite inner product on M m+3 . 
It follows from g G 0(m + 1, 2) that 

x + x m+2 = (eo + e m+2 ,g(e - e m+2 )) 
= (^(eo + e m+2 ), e - e m+2 ) 
= (Im+1,29 1 I m +i,2{eo + e m +2), eo - e m+ 2) 
= (y,e + e m+2 ) 

= yo + y m +2- 
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If x + x m+2 / 0, we set 

a:=(ai,...,a m+1 ), aj := - 1 (l<J<m+l), (7.1.5) (a) 

V0 + Vrn+2 

b:= (6i,...,6 m+ i), bj:=^i (l<J<m+l), (7.1.5) (b) 

Xo -r X m+ 2 

5 := sgn(x + x m+2 ), (7.1.5) (c) 

, Xq + X m+2 

t := log - 

m + := 5e~ tE n_ b gfi_ a w 1 . (7.1.5) (e) 

Lemma 7.1.1. Retain the above notation. 

1) For g G 0(m + 1, 2), the following three conditions are equivalent: 



(7.1.5) (d) 



i) g P max , 

ii) x + x m+2 / 0, 

iii) Vo + y m +2 / 0. 

2) Suppose one of (therefore, all of) the above conditions holds. Then, 
the element m + defined by (7.1.5) (e) belongs to M™ 2 ™ ~ 0(m, 1). 

7.2 Explicit action of the whole group 

For g G 0(m + 1, 2), we set 

x = \x , . . . ,x m+2 ) := g(e - e m+2 ) (see (7.1.3)), 

V = \yo, ■ ■ ■,y m +2) ■= g~ l {eo - e m+2 ) (see (7.1.4)). 

For g such that xo + x m+2 / 0, we also set a = (oi, . . . , a m+ i), b = 
(bi, . . . , b m+ i), S G {±1}, and m + as in (7.1.5). 

If xo+x m+ 2 = 0, then g G P max and (Tv(g)ip)(Q is obtained readily by the 
formulas (2.2.2)-(2.2.5). For generic g such that xo + x m+2 / 0, the unitary 
operator n(g) can be written by means of the kernel function K((, (') (see 
(6.4.1) for the definition), the above x, y G R m+3 and m + G M^ nax ~ 0(m, 1) 
as follows: 

Theorem 7.2.1. For g G 0(m + 1, 2) such that xo + x m+2 ^ 0, £/ie unitary 
operator ir(g) is given by the following integral formula: for tp G L 2 (C), 

(2 \ mL7 T~ Zy^Tt^iCiH Vx m+1 C m+1 ) 
: e ~ -0+^+2 
x + x m+2 J 



/ K — — ± , , m + C e yo + y m+ 2 Y>(C')<MC')- 

Jc \\xo + x m+2 \ J 
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Proof. We write g = n^e 1 (5m + )won a as in the form (7.1.1). Then, we have 

(tG/)V0(C) 

= 7r(n fe )7r(e' )Tr(5m + )(Tr(won a )ip)(() 

= e 2V ^ T{b '°e^ I!1 2 lt 5 m ^ 1 (TT( y w n a )iP)(e- tt m + C) by (2.2.2)-(2.2.5). 
Now, by using Corollary 6.4.1, 

□ 



8 Appendix: special functions 

For the convenience of the reader, we collect here basic formulas of special 
functions in a way that we use in this article. 



8.1 Laguerre polynomials 

For a £ C, n £ N, the Laguerre polynomials L®(x) are defined by the formula 
(see [1, §6.2], for example): 



: = X ° " (e- x x n+a ) (8.1.1) 



(a + l) n -A (-n) fc x 



fc 



n! ^(a + l) fc /c! 
fc=o v 7,c 

_ (-l)"n i i (a + l)(a + 2)--> + n) 
— . x -f- • • • i- 

n! n! 

Here, we write j3 n for /3(/3 + 1) •••(/? + n — 1). The Laguerre polynomial 
solves the linear ordinary differential equation of second order: 

xu" + (a + 1 - x)v! + nu = 0. (8.1.2) 

Suppose a G M and a > —1. Then the Laguerre polynomials {L"(x) : 
n = 0, 1, ■ ■ ■} are complete in L 2 ((0, oo), x a e _:r <ix), and satisfy the orthogo- 
nality relation (see [1, §6.5]): 

LZ l (x)K(x)x a e- x dx = T ^ a + 7 ! + l h mn (a > -1). (8.1.3) 
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The Hille-Hardy formula gives the bilinear generating function of La- 
guerre polynomials (see [6, §10.12 (20)], [14, §1 (3)]): 



Here the left-hand side converges absolutely. 
8.2 Hermite polynomials 

Hermite polynomials H n (x) are given as special values of Laguerre polyno- 
mials. We recall from [6, II, §10.13] that 



This reduction formula is reflected by the fact that Hermite polynomials 
appear in the analysis of the Weil representation of SL(2, MJJ while Laguerre 
polynomials appear in the analysis of the minimal representation of SOo(m+ 
l,2fand Sp(m,RY{see Remark 4.3.2). 

8.3 Gegenbauer polynomials 

For i/£C and I £ N, the Gegenbauer polynomials C^(x) are the polynomials 
of x of degree / given by the Rodrigues formula (see [1, §6.4]): 




x > 0, y > 0, \w\ < 1. 

(8.1.4) 



H 2m (x) = (-l) m 2 2m m\L m *(x 2 ), 
H 2m+ i{x) = (-l) m 2 2m+1 m\xLi(x 2 ) 



(8.2.1) 



(8.2.2) 




(8.3.1) 



It then follows from (8.3.1) that 



T(2u + l) 
l\T(2u) ' 



We renormalize the Gegenbauer polynomial by 



Cr(x) :=r(»)C?(x). 



(8.3.2) 
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Then by the duplication formula of the Gamma function: 

T{2u )= T{u)T{n+-), 

we have 

Cl (1) - 2*»-H\v( v + \y (8 ' 3 - 3) 

The special value at v = is given by the limit formula (see [6, I, §3.15.1 
(14)]) 

C,°(cos0) = limr(i/)(T(cos0) = 2cos } W \ 

v— >0 ( 

Suppose Re^ > —\. Then, {C\{x) : I = 0,1,2,...} forms a complete 

orthogonal basis of L 2 ({— 1, 1), (1 — x 2 ) v ~^dx), and the norm of C[(x) is 
given by 

(8.3.4) 



/. 



(see [6, I, §3.15.1 (17)]). Therefore, / G L 2 ((-l,l),(l -x 2 ) u ~2dx) has the 
following expansion: 

oo 

f(x) = J2^(f)Cr(x), (8.3.5) 

where we set 

«T(/) == 2 J^ r | 2 ^ +0 /' /(x)CT(x)(l - x 2 )^ldx. (8.3.6) 

The following integral formula is used in the proof of Lemma 8.5.2 (see 
[7, §16.3 (3)]): Suppose Re/? > -1 and Rev > -\. 



{l-x) v -^{l + xfC^{x)dx = 

h -+- 1 ^irr^zy + r^rc/? - u + §1 

;8.3.7) 



2^-"+l0Fr(/? + i)r(2z/ + n)r(/? - ^ + 1) 

n! T(/3 - 1/ - n + § )r(/3 + 1/ + n + |) 

8.4 Spherical harmonics and Gegenbauer polynomials 

Let Agn-i be the Laplace-Beltrami operator on the (n — l)-dimensional unit 
sphere S 1 ™ -1 . Then the spherical harmonics on S 1 " - " 1 are defined as 

X l (R n ) := {/ G C 00 ^- 1 ) : A^-i/ = -/(/ + n - 2)/}, Z = 0, 1, 2, . . . . 
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The following facts are well-known: 

(1) 3i'(R n ) is an irreducible representation space of 0(n). 

(2) It is still irreducible as an S'0(n)-module if n > 3. 

(3) "K l (M 2 ) = Ce^ w Ce-^ 116 , I > 1 as 50(2)-modules, where 



9 = tan" 1 fa (^,i 2 )eR 2 . 

(4) ^{ z (IR n )| 0(n _ 1) ~ ©Uo^O*"" 1 ) S ives an irreducible decomposition 



of 0(n— l)-modules. This is also an irreducible decomposition as SO(n— 1)- 
modules (n > 4). 

We regard 0(n — 1) as the isotropy subgroup of O(n) at (1, 0, ■ ■ ■ ,0) 6 
IR n . We write (x±, ■ ■ • , x n ) for the standard coordinate of W 1 . Then, 0(n — 
l)-invariant spherical harmonics are unique up to scalar, and we have: 



^ M n)0(n-1) 



, . n — 2 



~ CC t 2 (m). 



(8.4.1) 



8.5 Bessel functions 



For v e C, z G C \ M<o, Bessel functions J v (z) are defined by 




(8.5.1) 



It solves the Bessel 's differential equation of second order: 




The modified Bessel functions I v {z) are defined by 




(8.5.2) 



oo 



(!) 



2m 




(8.5.3) 



For a special value f 



±2> Iy{ z ) reduces to 




(8.5.4) 



52 



We set 

,2m 



1 \ { z \ ^ 

(f)"*W-£ m ir(L^ +1 ) - < 8 ' 5 ' 5 > 



ml T(u + m + 1) ' 



m=0 

,2m 



_ oo / z V 

/„(*) : = f "j,,^) = y — — ^ -. (8.5.6) 

m=0 

We note that J u (z) and I v (z) are entire functions of z, and 

J„(V=Iz) = J„(z). 

The following lemma on the estimate of /-Bessel functions are used in 
Subsections 4.4 and 5.2. We need an estimate of l v {z) for v > — ^: 

Lemma 8.5.1. There exists a constant C > such that the following esti- 
mate holds for all z G C: 

\Iu(z)\ < Cel Re2 L (8.5.7) 

Proo/. First, suppose i/ = — \. Then |/^(z)| = -^\ coshzj < -^=el Rez L 

Next, suppose v > — \. By an integral representation of the Bessel 
function [33, §6.15 (2)]: 

/„(*) = -. \, r(1 , f e-*\i - fy-Ut, 
r(i/+ 2)r( 5 ) J -i 

we have 

\Uz)\ < \ —j- f e-^ z {l-t^-Ut 

Y{u+ 5)1X2) 7-i 



2^ V2J 

;e |R ' : 

2^ V2"i ' ' 

for some constant C independent of z. □ 



JRez\ rl . 

< - lN n - (l-t 2 ) Kcv -2dt<Ce 



The following lemma is used in Subsection 5.5, where we set v = m j^,a 



2V2rr' 
sinh I 



Lemma 8.5.2. Assume aEC,v> — |, and / G N. T/ien we have: 

( I u (aVl + cos 6) Ci + ^ (cos 0) (1 + cos 0)~% sm 2u+1 9d6 
Jo 

= V a ;+i z , >-hv + 2i + i(V2a). (8.5.8) 
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We could not find this formula in the literature, and so we give its proof 
here. 

Proof. First we note that the integral (8.5.8) converges since I v (a(\/l + cos 8)) ■ 
(1+cos 6)~% is continuous on the closed interval [0, ir]. Furthermore, we have 
a uniformly convergent expansion 

, x , , x , ^ (%Y +2j (i + cos ey 

/ v (a(vT + ^)) • (1 + cos 0)"* = £ 2, m - + u + l) ■ 
Now the left-hand side of (8.5.8) equals 



(f) y E JTUTVTT) L (1 + cos^Cr +5 (cos ^)sin^^ 



- fVy (f) 2i 2J+ 1 y?r(i + z.+ i)r(2^ + / + i)r(i + i) 
2 A.j!r(i + ^ + i) nr(i-/ + i)r(2z. + j + / + 2) 



,a,„ 2v5Fr(2i/ + Z + 1) ^ (^) 



2.7 



zi ^r(i-/ + i)r(2^ + i + / + 2) 



~^2> Z! \^/2> ^ r(n + l)r(2i/ + 2/ + n + 2) 

= the right-hand side of (8.5.8). 

Here the first equality follows from the formula (8.3.7). In fact, the substi- 
tution of x = cos 9 into (8.3.7) yields 

( (1 + cos 0yC? + * (cos 6) s\n 2u+1 0d6 
Jo 

= J {l-xy{l + x) j+u C^(x)dx 

_ T +1 ^T{j + u + l)T{2v + I + l)T{j + 1) 

z!r(j-z + i)r(2z/ + j + z + 2) 

Thus, the lemma has been proved. □ 
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